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Abstract: This paper deals simultaneously with linear structural and func- 
' tional error-in- variables models (SEIVM and FEIVM), revisiting in this 

context generalized and modified least squares estimators of the slope and 
intercept, and some methods of moments estimators of unknown variances 
. of the measurement errors. New joint central limit theorems (CLT's) are 

established for these estimators in the SEIVM and FEIVM under some 
first time, so far the most general, respective conditions on the explanatory 
variables, and under the existence of four moments of the measurement er- 
rors. Moreover, due to them being in Studentized forms to begin with, the 
obtained CLT's are a priori nearly, or completely, data-based, and free of 
unknown parameters of the distribution of the errors and any parameters 
associated with the explanatory variables. In contrast, in related CLT's in 
the literature so far, the covariance matrices of the limiting normal distribu- 
I tions are, in general, complicated and depend on various, typically unknown 

QQ , parameters that are hard to estimate. In addition, the very forms of the 

. CLT's in the present paper are universal for the SEIVM and FEIVM. This 

• ' extends a previously known interplay between a SEIVM and a FEIVM. 

(J> ' Moreover, though the particular methods and details of the proofs of the 

<^ ' CLT's in the SEIVM and FEIVM that are established in this paper are 

^ quite different, a unified general scheme of these proofs is constructed for 

, the two models herewith. 
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1. Introduction 

First, we present linear structural and functional error-in-variables models, as- 
sumptions that will be used in each of them, and estimators of unknown param- 
eters of interest under study (cf . respective Sections I1.1H1.3[) . We then discuss 
the essence of the main results of this paper in Section 11.41 

1.1. Linear structural and functional error-in-variables models 

(SEIVM and FEIVM) 

In the linear structural and functional error-in-variables models (EIVM's) of 
this paper we observe pairs {yi,Xi) e according to 

Vi = I3£,i + a + Xi = Ci+ei, (1.1) 

where are unknown explanatory/latent variables, the real- valued slope /? and 
intercept a are to be estimated, and Si and Si are unknown measurement error 
terms/variables, 1 < i < n, n € IN. EIVM (II. ip is also known as a measurement 
error model, or structural/functional relationship, or regression with errors in 
variables. It is a generalization of the simple linear regression of form yi = 
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P£.i + a + 5i in that in (jl.ip it is assumed that, in addition to the two variables 
77 :— + a and ^ being linearly related, now not only 77, but also ^, are observed 
with respective measurement errors Si and e^. 

The explanatory variables are assumed to be independent identically dis- 
tributed (i.i.d.) random variables (r.v.'s) that are independent of the error terms 
when we deal with the structural EIVM (SEIVM) (cf. upcoming condition 
(S2)), and deterministic in case of the functional EIVM (FEIVM). 

1.2. Assumptions in SEIVM and FEIVM 

Both in the SEIVM and FEIVM versions of (|l.ip , the following assumptions are 
made on the error terms. 

(A) {{S,e), {6i,ei), z > 1} is a sequence of i.i.d. random vectors with mean 
zero, E 5'^ < 00 and E < 00, and with a positive definite covariance 



(B) The r.v.'s S and e are either both continuous, or one of them is continuous, 
and the other one is discrete. 

In the SEIVM, we suppose that the explanatory variables {£,, i> 1} obey 
(SI) and (S2) as follows: 

(51) {^, ^i, i > 1} are i.i.d. r.v.'s in the domain of attraction of the normal law 
(DAN), i.e., there are constants a„ and fe„, 6„ > 0, for which {J27=i ^ ^n) 

^ N{0, 1), as n — > 00. 

(52) ^ is independent of {S,e). 

Remark 1.1. Further to the definition of DAN in (SI), it is known that a„ can 
be taken as nE £^ and 6„ — n^/^£^(n), where i(^{n) is a slowly varying function 
at infinity (i.e., i^{az)/i^{z) — > 1, as z — > 00, for any a > 0), defined by the 
distribution of Moreover, i^{n) — ^/VaiS, > 0, if Var^ < 00, and i^{n) / 00, 
as n — !■ cx), if Var^ = 00. Also, ^ has moments of all orders less than 2, and the 
variance of ^ is positive, but need not be finite. 

Remark 1.2. One of the several necessary and sufficient conditions for i.i.d. r.v.'s 
{Z, Zi,? > 1} to be in DAN is commonly associated with O'Brien [12] (for 
more details see also Remark (iii) in Mailer [13], p. 194), and it reads as fol- 
lows: maxi<j<„ Zl / X)r=i 0, n ^ 00. In Remark (iv) of Mailer [T3| it 



is pointed out that this "negligibility" condition has appeared and played an 
important role in the asymptotic theory of many stochastic models. In addition 
to the models listed in [T^ , Z G DAN has also been used for CLT's in a simple 
linear regression (cf. Mailer [T^]) and, as frequently an optimal, or nearly opti- 
mal, condition on the explanatory variables, for various marginal CLT's in the 
SEIVM in]) (cf. Martsynyuk [TUTHin]). 



matrix 




(1.2) 
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For the deterministic in the FEIVM (jl.ip . we assume the following (Fl)- 
(F3) conditions that, in view of Remarks 11.11 and 11.21 are natural companions 



to (SI). 

(Fl) lim„^oo X^iLi = ^ind m is finite. 

(F2) Either < lim„_,oo ^27=1 < lini„^oo ""^ I]"=i if = 



For some further comments on the introduced assumptions on the explana- 
tory variables in the SEIVM drj) and FEIVM dTT]), we refer to Remarks [2l0l 
and \2JT\ of Section O 

To ensure identifiability of unknown parameters in the SEIVM and FEIVM 
versions of (II. 1|) . it is common to make use of some additional side conditions 
in this regard, usually as conditions on the matrix F of (|1.2p in (A). Here we 
distinguish three most frequently used identifiability assumptions, namely: 

(1) the positive ratio of the error variances A =Var(5/Vare is known, and the 
covariance of 6 and e is zero, i.e., cov{6,e) — fi ^ 0; 

(2) Var 6 — Xd and cov{6, e) — fj. are known, while Var e — 9 is unknown; 

(3) Vare = 9 and cov((^, e) — /i are known, while Var (5 — X9 is unknown. 

The identifiability assumption (1) corresponds to orthogonal regression es- 
timation in ()l.ip . while (3) is likely to be realistic in many applications (cf. 
Carroll and Ruppert [1], Carroll et al. |2], Cheng and Van Ness [4] and Fuller 
[6] for some further discussions along these lines). 

1.3. Estimators for slope (3, intercept ex. and unknown error 
variances 

For further use throughout, for real-valued variables {ui, 1 < i < n} and 
{vi, 1 < i < n}, we put 



Under each of the identifiability assumptions in (l)-(3), we are to estimate 
the slope /3, intercept a, and the respective, typically unknown, error variance 
X9, or 9, that is denoted throughout by 7 for convenience in notations. 

When (1) is assumed, it has been common to estimate /3 and a with gener- 
alized least squares estimators (GLSE's) /3i„ and ain that are simply derived 
under (A) without assuming the finiteness of the fourth error moments (cf., 
e.g.. Section 3.4 in [4J). For estimating 7 = 0, a method of moments estimator 
(MME) 7i„ is a usual one. Provided that Sxy 7^ 0, these estimators are given 



(F3) 




0, n 



00. 
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by 

An = sign(5.,) J + A - , 

(1.3) 



ain =y- xPin, lln = — —, 

A + /32„ 

where sign{Sxy) denotes the sign of Sxy 

When either (2) or (3) is assumed, modified least squares estimators (MLSE's) 
for f3 and a (of. Section 3.5 in [3]), and MME's for the respective unknown error 
variances j = 6 and j = Xd are available. The MLSE's and MME under (2) are 

An = ^ Oi-in = y-xAn and 72„ = Sxx - — (1-4) 

^xy M 

assuming that Sxy — /i 7^ and Syy — X9 > 0, while those under (3) are 

An = ^ ^, "Sn = y - xAn and 73„ = Syy - {Sxy - fJ-)An, (1-5) 

provided that Sxx — > 0. 



1.4- Introduction to main results 

In this paper, we revisit the triples of the estimators in (|1.3p - (|1.5p in the SEIVM 
and FEIVM versions of (|l.ip . and prove two joint central limit theorems (CLT's) 
for each of the triples (cf. Theorem 12. 1|) . under the respectively introduced as- 
sumptions on the explanatory variables that are, to the best of our knowledge, 
the most general ever used so far in this context (cf. Remarks 12.21 12.3) . As to 
the conditions (A) and (B) on the error terms here, they seem to be the least 
restrictive that have been considered in the literature thus far (cf. Remarks 12 .21 
[231 [2:51 12:91) . 

Further to the special features of our CLT's in Theorem 1 2. 11 these CLT's are 
in Studentized forms to begin with and, as a result, are automatically nearly, or 
completely, data-based. Namely, as compared to the related CLT's for (/?, a, 7) 
in the literature, the ones in Theorem 12.11 are a priori free of any unknown 
parameters associated with the explanatory and error variables (cf. Remarks 
[231 and (2:61) . 

The CLT's of Theorem 12 . 1 1 also extend a previously known interplay between 
a SEIVM and a FEIVM as in Gleser [8| . This extension is due to a synchronized 
choice of the respective conditions on the explanatory variables in the SEIVM 
and FEIVM of the present paper (cf. Remark l2.1ip . Consequently, the CLT's of 
Theorem 10 are universal in form for the SEIVM HH]) and FEIVM (cf. 
Remarking). 

The idea of establishing the joint CLT's of Theorem 12.11 for the estimators 
in (|1.3p - (|1.5p has originated from a wish to extend and unify the Studentized 
marginal CLT's for each of these estimators that are proved, among other things, 
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for the SEIVM in Martsynyuk [H [H [H] , and for the FEIVM (HH]) in 

Martsynyuk [121 ES] > under nearly the same respective model assumptions as 
those in Theorem 12. II When establishing the multivariate CLT's of the present 
paper, it was important for us to preserve and build on the new assumptions 
on the explanatory variables that had first been introduced and used in the 
SEIVM dfl]) and FEIVM in [Ml [15] (cf. Remarks [2l0l and \2AT\ on the 

crucial roles of (SI) and (F1)~(F3) in [TH [H]). However, it was even more 
desirable that the CLT's for {(3,a,j) should be of suitable Studentized forms, 
like their marginal predecessors, and so that they would also be universal in 
form both for the SEIVM ([Ll]) and FEIVM ([rT|) . 

Theorem 12.11 would have remained a wishfuU thinking only if not for the 
auxiliary results in Section [3] that bridge the context of the SEIVM (jl.ip and 
FEIVM (|l.ip with recent advances in Studentization of random vectors by a 
matrix, the generalized domain of attraction of the multivariate normal law 
(GDAN), and the domain of attraction of the univariate normal law (DAN). 
For the sake of providing convenient reference in Section [3l we summarize some 
of these advances in the subsidiary Section [H Among the auxiliary results of 
Section [31 the key Theorems 13.11 and 13.21 of Sections 13.11 and 13.21 respectively, 
namely, a CLT for a multivariate Student statistic that is based on indepen- 
dent but not necessarily identically distributed random vectors that satisfy the 
Lindeberg condition, and a special characterization of GDAN, may also be of 
interest beyond the scope of the present paper. Also, the auxiliary CLT's of Sec- 
tion [231 are rather versatile, and can also be used to prove multivariate CLT's 
for estimators other than ([r21)-([r5l) in the SEIVM ([LT]) and FEIVM ([Tl]), and 
in the respective no-intercept versions of these models, where a is assumed to 
be zero (cf. Remarks 13. 41 and 13. 5p . Although the particular methods and details 
of the proofs of Theorem [O for the SEIVM and FEIVM versions of HU) are 
fundamentally different, a unified general scheme of these proofs is constructed 
for the two models (cf. Sections |3 .31 and . 

This paper is based on parts of the author's Ph.D. thesis Martsynyuk [15], 
written under the supervision of Miklos Csorgo, and on parts of Martsynyuk 

M- 

2. Main results 

2.1. Main results with remarks 

The (a) and (b) parts of Theorem 12.1) namely the Studentized CLT's for the 
triples of the estimators in ([L3])-([Il5]) in the SEIVM HI]) and FEIVM ([H]), 
constitute the main results of this paper. 

In the sequel, all vectors are row- vectors. For vectors Zi, • • • , Z„ and Wi, • • • , 
Wn in IR'', > 1, introduce vector Z = ?^~^X]"=i^* ^^'^ matrix Vzw = 
(n- l)-i J27=^ s^^zw, where s^,zw = {Z^-Zf(W^-W) and {Z, -Zf is the 
transpose of Zi — Z. For a positive definite matrix yl (^4 > 0), notation A^/^ 
stands both for the (left) Cholesky and symmetric positive definite square roots 
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of A. We recall that the (left) Cholesky square root A of A > is the uniquely 
existing lower triangular matrix with positive diagonal elements that is such that 
^i/s^^i/z-jT _ ^ Clearly, it is invertible. As to the symmetric positive definite 
square root A^^^ of matrix A > 0, the latter exists and satisfies (A^/^)^ = A, 
where A^/^ = {A^/^- By definition, A^/^ = {A^/^)^, A^^l^ = (Ai/2)-i and 
_ (^-i/2)T^ Notation diag(-, •••,•) stands for a block-diagonal matrix, 
where in the brackets square matrix blocks that are on its diagonal are listed. 

Theorem 2.1. Let assumptions 

( (A), (B), (SI) and (S2), in the SEIVM (f7j|) . 
\ (A), (B) and (F1)-(F3), m the FEIVM (f7J|) . 

be satisfied. Suppose also that the identifiability condition in (l)-(3) that is 
appropriate for the estimators in hand is valid. Let 

(2S,y ,tfj^h rn-i(n-2)(A + ^2j , = 

U (j, n)={S^y-^j.,ifj = 2, L{j, n)=ll , if j = 2, 

[s^^-e ,if3^i, [l ,*/j=3, 

(2.1) 

\^(xs- -s -^s- ] 

I A + /32 [^'^'^^ '^'^y p '''^y J ,^IJ~^, 

MJ.n,P)-< (,^^^,^_A^?)-/3(,s,,.,-M) ,^f3=2, ^'■'> 

[ {Si^a:y - tJ.) - PiSi,xx ~ 0) , if j ^ 3 , 

"x 

Vi{j,n,l3) ^y^- a- I3xi - —. — -u,{j,n,l3), 1 < j < 3, (2.3) 

{{si,yy - Xe) - 2f3{si^^y - f3'^{si^xx - 0) , if 3 = I, 
rV(l,n,/3) ,^f3 = 2, (2.4) 

Wi(l,n,/3) , if j = 3, 

Zi(j,n,(3) ^ {ui{j,n,l3),Vi{j,n,(3),w.i{j,n,l3)^, 1 < j < 3. (2.5) 

Then, for 1 < j < 3, as n oo, the following CLT's hold true: 

(a) Vn (u (j, n){f3jn-f3),ajn-a, L{j, n)(7j„-7)) y^J,i%,(j^n,/3) ^ ^(^^ h); 

ih)V^(u{j,n)0jn-p),ajn-a,L{j,n){j,n-l))v~.^/\ ^ ^iV(0,/3). 

Remark 2.1. Matrices V , . a\ r ■ a\ and ' ^ ^ in the respective 

(a) and (b) parts of Theorem 12.11 are well defined both in the SEIVM and 
FEIVM. Indeed, for j = 3, on combining Remark Ol and ^^FJ\i with 

Pi{n) of p.86p . we conclude that V^(:i^n,p)z(:i,n,i3) > and ^^(s.n,^;: „)2(3,«,/3 „) > ^ 
on sets whose probabilities converge to one, as n — s- oo. We note that matrices 
Bn in (|3.80p are invertible in view of (|3.72p and Remark l3.3l Similar arguments 
apply in the case of j = 1 or j = 2. 
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Remark 2.2. In view of Remark 1 1. 11 the assumption ^ e DAN of (SI) in the 
SEIVM (|l.ip is weaker than the following one: 

= m and Var^ = £'C^ - {E M - > 0, with M < oo. (2.6) 

Also, conditions (F1)-(F3) on the explanatory variables in the FEIVM 
are less restrictive than those of 

^ — > TO and ^-^ M, as rt — > oo, and M — > 0, with finite m and M. 

(2.7) 

Indeed, convergence of to the finite positive limit M implies that n ■^^'^ = 
— n^^{n — l)(n — 1)^^ X^iLi & — > 0, n — s- oo, and the latter convergence, via 
a proof by contradiction, leads to n^^ maxi<i<„^? — > 0, n — s- oo, and thus, to 
(F3). While conditions (|2.6p and (12. 7p have commonly been used for the CLT's 
in the SEIVM's and FEIVM's in the literature so far, our (SI) and the group 
of assumptions of (F1)-(F3) are believed to be new respective assumptions for 
these models. More precisely, (SI) and (F1)-(F3) have first been introduced 
respectively for the SEIVM and FEIVM dLl]) in Martsynyuk [HI [15] (cf. 
also Remarks 12.101 and 12. lip , and have not yet been used in EIVM's by other 
authors. As to the conditions on the error terms in (A) and (B) here, they seem 
to be the least restrictive that have been considered for CLT's thus far (we will 
elaborate further on the assumption (B) in Remarks 12.81 12. 9p . 

Remark 2.3. In the literature, the vectors of the estimators {Pjn,cijn,Jjn), 
1 < j < 3, are known to be -^71— asymptotically normal (cf., e.g., Gleser [3 [5] 
for j = 1, Cheng and Van Ness [3] for j = 2 and 3), under the respective iden- 
tifiability assumption in (l)-(3), (A), and ((Mj) and (S2) in the SEIVM, or 
p.7p in the FEIVM, and, in case of [3], also under the condition that ^, S and 
£ are indepedent normal r.v.'s in the SEIVM, and that S and e are independent 
normal r.v.'s in the FEIVM. In view of Remark [121 if and ([^ are not 
assumed, then the CLT's of Theorem 12.11 appear to be first time ones. Oth- 
erwise, under ((Mj) (in the SEIVM), or ((2J|) (in the FEIVM), subject to the 
above mentioned additional normality conditions in [3] and comments on (B) 
in upcoming Remarks 12.81 and \2M the CLT's of [3l|7ll3 follow respectively from 
those in Theorem 12. II For the proof of this statement, we refer to the very end 
of Section [SH 

Remark 2.4. Theorem l2.1l is a unifying generalization of the author's Studen- 
tized marginal CLT's for /3j„, ajn and jjn-, 1 < J < 3, that are established for 
the SEIVM ^ and FEIVM ^ respectively in [Ml[15l[17j and [15l[16j. Also, 
Theorem 12. II is proved under nearly the same assumptions as those used for the 
marginal CLT's in [14l[l5l[l6l[17]. 

Remark 2.5. Due to them being in Studentized forms to begin with, the CLT's 
of Theorem l2.1l are a priori free of any unknown parameters (such as moments) 
of the distribution of {S, e) depend only on the error moments that are assumed 
to be known according to the corresponding identifiability assumption in (1)- 
(3)), and do not contain any parameters associated with ^ in the SEIVM and 
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{6, i > 1} in the FEIVM. In addition, the CLT's of the (b) part of Theorem 
12. H are completely data-based. Hence, the latter CLT's are readily applicable to 
constructing large-sample approximate confidence regions for (/3, a,7). 

Remark 2.6. A priori Studentized forms, and the corresponding features de- 
scribed in Remark 12.51 of our CLT's make them new even under the stronger 
conditions in (|2.6|) and (|2.7p that were used in the CLT's of [3l[7l|8]. Indeed, as 
opposed to Theorem l2.1l the expression (the same for the SEIVM and FEIVM) 
for the covariance matrix of the asymptotic normal distribution of {Pim 7i„) 
that is due to Gleser [71 [H] is complicated, and in addition to the unknown pa- 
rameters /3, m and M, where m and M are as in (|2.6p and (|2.7p . it involves 
typically unknown cross-moments and moments of order < 4 of the error terms 
that are hard-to-estimate from data. Then, in order to be able to estimate the 
covariance matrix of the CLT in (in the FEIVM) , it is additionally assumed 
that the moments of S and e are like those of two independent normal r.v.'s. 
Consequently, the covariance matrix of the latter CLT becomes much simpler 
in form and contains only the unknown, but estimable /3, m, M and 7 = X9. As 
to the respective asymptotic covariance matrices of {j3jn,0ijmljn) in [3], j = 2 
and 3, similarly, what results in their simple forms, and hence straightforward 
estimability, is the normality conditions on independent ^, 5, e in the SEIVM 
and independent 5, e in the FEIVM that are required for the CLT's in [3]. 

Remark 2.7. Studentized bivariate CLT's for (/3j„,aj„), (/3jn,%ri) and (ajn, 
Ijn), 1 < i < 3, that are similar in form and features to those in (a) and (b) of 
Theorem 12 . II also hold true. The proofs of such CLT's are based on the auxiliary 
CLT's in Theorem 13.41 and are like the proofs of (a) and (b) of Theorem 12. II 

Remark 2.8. Condition (B) on the error terms in Theorem 12.11 imposes hardly 
any restrictions, and is only assumed there for the sake of checking p.72|) that, 
in particular, implies that in the (a) and (b) parts, the respective matrices 
yz(j,n,i3)zU,n,i3) and ^^Q- „ „ ;g^.^) are positive definite on sets whose prob- 

abilities go to one, as n ^ 00. Moreover, along the lines of the proof of (|3.72p . 
it is not hard to see that the Studentized bivariate version of Theorem 12.11 for 
{Pjn,cijn) does not require assuming (B) at all. 

Remark 2.9. Under (l2?6l) and ([2Jl) . matrices 

(diag(t/(j, n), 1, L(j, n))) ~ V^(^. (diag(L/(j, n), 1, L{j, n))) ' 

are natural estimators for the respective asymptotic covariance matrices of 
{f3jn,cijn,Jjn) obtained in [3l [71 [8] (for the proof in the case of j = 3 see 
([3^ . ([3^ and ((3?89|) - ((3?9T|) ). These matrices are different from the respec- 
tive estimators in [3l [71 [8] that were constructed under the additional normality, 
or normality like, conditions specified in Remark 1 2. 61 and also work when these 
conditions fail. These normality conditions also ensured positive definiteness of 
the asymptotic covariance matrices of (/3j„, Sj„, 7j„) in [3l [71 [8], 1 < j < 3, 
but they seem to be more restrictive than our weak assumptions of (B) that 
guarantee such positivity on account of (|3.72p and p.89p ~ p.9ip . 
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2.2. Interplay between SEIVM and FEIVM 

Remark 2.10. We elaborate further on assumption (SI) on the explanatory 
variables in the SEIVM (jl.ip . (SI) is inherited from the author's previous work 
in [14], where it was introduced the first time around for SEIVM 's. In [14] that 
also led to [HI [17], the motivations for introducing (SI) into the asymptotic 
theory in the SEIVM (|l.ip amounted to more than just aiming at a general- 
ization of the usual assumptions in (|2.6p that had been used in the literature 
before. From the empirical standpoint, by letting in (|l.ip to have an infinite 
deviation (Var^ = oo), we make them more dominant over the errors with finite 
variances. This, in turn, renders observations yi and Xi to be more robust to 
noise (errors) and thus, more precise. Moreover, from a rigorous mathematical 
point of view, condition ^ g DAN is optimal, or nearly optimal for the marginal 
CLT's for and ajn in [ll[15l[17], 1 < j < 3 (cf., e.g.. Proposition 1.1 in 
[14]). In additon, some distinctive features of the SEIVM's under Var^ = oo 
were discovered (cf., e.g., Corollary 1 and Remarks 5, 6, 7, 9 in [TT]). 

Remark 2.11. Assumptions (F1)-(F3) on the explanatory variables in the 
FEIVM pri]) were first introduced and used in the FEIVM ([TT]) in 15j. In fTS], 
for the sake of achieving a strong similarity between the marginal CLT's for f3jn, 
cijn and 7j„ in the FEIVM dTl]) of JLSj and those in the SEIVM of [H), 
assumptions (F1)-(F3) on the deterministic £,i were introduced in such a way 
that, due to Remarks 11.11 and 11.21 they would be natural companions for the 
DAN condition in (SI) on stochastic in [14]. An empirical rationale behind 
allowing lim„^oo = oo as in (F2) is similar to that behind possibly having 
Var^ = oo as in (SI) (cf. Remark I2.10p . Also, (F3) is in some sense optimal 
for the marginal CLT's for /3j„ and ajn in [15], 1 < j < 3 (cf. Remark 2.1.8 
of [E]). A further similarity of (SI) and (F2) relates to the fact that their 
respective partial cases Var^ — oo and lim„^oo = oo make the SEIVM (jl.ip 
and FEIVM ([TT]) behave as if they were the simple regressions yi — [3xi + a + 5i 
(cf. Remarks 1.1.6, 2.1.10 and Sections 1.1.5, 2.1.5 in 15j). 

Remark 2.12. Between the SEIVM under and the FEIVM under ([2J)) 
there is an interplay established by Gleser [5] that yields, in particular, that the 

CLT's for {f]jn,ajn,^jn) as in [SlIZ], j = 1,3, that are proved in the FEIVM 
under ([27]) also hold true in the SEIVM with {^, ^i, i > 1} satisfying ([2?6)) . 
Similarly, the identity in form of the marginal CLT's for /3j„, ajn and in 
the FEIVM under (F1)-(F3) in [H] to those in the SEIVM under (SI) of [H] 
establishes an asymptotic interplay between these two more general models. The 
CLT's for {f3jn,(ijn,Jjn) as in Theorem 12.11 and the respective bivariate CLT's 
as in Remark 12. 71 are also universal in form for the latter two models, invariant 
as to whether the explanatory variables have a deterministic nature, as in the 
FEIVM, or a stochastic nature, as in the SEIVM, and thus, further contribute 
to the models' interplay in terms of their asymptotics. 



Yu. V. Martsynyuk/ChT's in error-in-variables models 



357 



3. Auxiliary results and proofs of main results 

3.1. CLT for a multivariate Student statistic that is based on 

independent random vectors satisfying the Lindeberg condition 

In this section we state and prove Theoreni l3.ll a key auxiliary CLT required for 
the proofs in the FEIVM of this paper. It may also be of independent interest. 

For random vectors Zi, ■ ■ ■ , Zn in IR'' , we introduce a multivariate Student 
statistic as follows: 

Stn{Z) V^ZVzP\ (3.1) 

1 /2 

where is either the (left) Cholcsky, or the symmetric positive definite, 

square root of the matrix Vzz — {n— 1)^^ X]"=i(-^i ^ — Z). In the latter 

case V^^^'^ — y^z^"^ ■ Hereafter, notations |j • ||, and Z^^^ respectively stand 
for the Euclidean norm in IR*^, an indicator function and the j"^ component of 
vector Z S IR'', d > 1. When we will write that a (random) matrix converges 
(in probability) to another (random) matrix of the same size, it will mean that 
each entry of the converging matrix goes (in probability) to the corresponding 
entry of the limiting matrix. 

Theorem 3.1. Let {Zi(n), 1 < i < n, n > 1} be a triangular sequence of random 
vectors in IR''. For each n > 1, suppose that Zi{n), • • • , Zn{n) are independent, 
E Zi{n) = and covariance matrices Gov Zi{n) are finite, 1 < i < n. Assume 
also that, as n ^ oo, 

n 

^CovZ,(n) ^ E > 0, (3.2) 
j=i 

with some limiting dx d matrix S, and that the Lindeberg condition is satisfied, 
namely, 

n 

for each fi>0, ^ ^ (||Z,(n)||2l{||2_(„)||>^}) ^ 0. (3.3) 

i=l 

Then, for the Student statistic StniZ{n)) as in ^S.l^ . as n ^ oo, StniZ{n)) 
iV(0,/d). 

Proof. According to the Lindeberg-Feller theorem (cf , e.g., 2.27 Proposition in 

[21]), (021) and dSSl) yield that X;r=i ^'(") ^ N{0,Y.), n ^ oo. Since E > 0, 
Theorem 13.11 follows via Theorem 14.11 from the latter convergence in distribution 
and from showing that 

{n - l)Vz(n)Z(n) S, OO. (3.4) 

The proof of ()3.4p goes first for Zi{n) that are such that the limiting matrix 
E = /d in 
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Lindeberg's condition (|3.3p implies that the same condition holds true for 
{Zp ■*(«), 1 < i < n, n > 1} for each I < j < d, that, in turn, results in 

Er=i (^.P (-)) \ e:=i f in) 'm^) ^ 

^ T-T^ 4 1 and ■ 



Er=iVarZp")( 



as n — + CX3 (cf., e.g., respective conclusions (3.6) and (3.7) in [TB]). Consequently, 



E:iiVarZ«(n) 



1, n ^ oo, 



and for having (|3.4p . it suffices to show the convergence in probability of the 
off-diagonal entries of the matrix (n — l)Vz{n)z{n) to the corresponding entries 
of the matrix Y, — Id, namely, for any 1 < j, /c < d, j ^ fc, as n —> oo. 



5;](zP(r.)-Z0-)(n))(zf )(n)-ZW(n)) ^ 0. 

4=1 

First, for any 1 < j, k < d, j ^ fc, we prove that 

n 

J2zl^\n)zl'\n)^0, 



n oo. 



(3.5) 



(3.6) 



Then, for (|3.6p to hold true, by Theorem 3 in [20] on p. 210, it is sufficient to 
show that for any > and some t > 0, as n — > oo, 



'11 

^P(|zp")(n)zf)(n) 



5: (Z«(n)zf)(n)) 



(3.7) 



)|<r} 



and 



Since 



n , 



0. 



(3.8) 



(3.9) 



5:p(|zp)(n)zf)(r 

1=1 

1 " /l 

^ - E ^ I ^ ^ (") 1 { I z(^' („)Z<^' („) I >4 

i=l ^ II • » I J 
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then p.7p with any > foUows from (|3.3|) . As to (|3.8p . we have 

" / 2 

E ^ (^^'^ (-) ^ (")) 1 1 1 z«) („)zf ) („) I < 1 1 

i=l ^ U » ' I J 

" / 2 

i— 1 ^ 

+ 5:^; (zP(n)zf)(n)) 1 



i=l 



^{|zf'(n)|<l} 



Sin + -B2n- 



For any (f> > and sufficiently large n, 



(Z,p)(n)zi'=)(n)) 1 



|Zj^'(n)|<l,|Zf' (n)|>-l/ - 



|z"'(n)|<l,|z<'''(«)|<'l/ ^ 



< 



(n))'l 



/ 2 

E^((^P'w) 1 

i=i ^ 



where, on account of (|3.2|) with Yi = Id and that z\''\n) satisfy Lindeberg's 



condition, Er=i^^((^F^N)'a{|zO)(„)|<ijj - lim„^o. Er=i Var Z)^^ (n) = 1, 
n oo. Consequently, 0, n oo. By symmetry, B2n — » 0, n ^ cx). 

Hence, p.Sp with t = 1 holds true. As to the convergence in p.9p . it is valid 
because p.3p and the assumption that S = in (|3.2[) (hence, lim„_>oo 

E (^Z,p^(ri,)zf for any 1 < j,k < d, j k) yeild that for any r > 0, 



lim Y.E[z\^\n)z\''\n)l 



Ji^ E ^ [Z'f^ (-)^f ^ { I z<^) („)Z<^' („) I >.} 



and 



lim 

n — >oo 



E^(^F^(")^l''(")l{|z«)(„)z<^)(„)|>.}) 
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^ i{|z«'(„)zf' („)|>.}) 

1 " 



This completes the proof of 

Now, since (EH) holds true and (^P^ (^) - ^(^'H")) (^f ■* (^) - ^^''^H) 

= Er=i z'f\n)Z'f\n) - nZU){n) to show (gH). it suffices to prove 

that for any 1 < j, k < d, j ^ k, 



nZU){n) ZC'^in) ^ Q, n ^ oo. 

The latter follows from (|3.2p and Markov's inequality for any 1 < j < d and 
(j) > 0, namely, 

.0) 




^ VarZ|^'(n) < ((/)n)-i 0, 



This also completes the proof of (|3.4p for Zi(rt) with E = in p.2p . 

When E ^ /d in dS^D, we take {Z.,(n) = Z,(n)E-^/2,l < i < n,n > 1}. 
Clearly, Zi(n) satisfy all the conditions of Theorem 13. 1[ with respective E = 
Id in (13. 2p . Hence, (|3.4p with Zi{n) replacing Zi{n) holds true, namely, (n — 
^^'^z{n)z{n) ~* ^d,' n ~* OO. Thc latter convergence imphes p.4p for □ 



Remark 3.1. Though the CLT of Theorem 13.11 appears to be quite natural, 
especially in view of the well-known multivariate Lindeberg- Feller CLT (cf., e.g., 
2.27 Proposition in 21j) and Thcorem l4.11 one essential link for its conclusion, 
namely, an appropriate version of (|4.ip as in (|3.4p used to be missing. Our 
(j3.4p is essentially a multivariate extension of a part of Raikov's theorem (cf. 
Theorem 4 on p. 143 in [9]) that amounts to saying that for r.v.'s {Xi{n), 1 < 
i < n,n > 1} that are independent in each row and satisfy the Lindeberg 

condition, we have — E Xi{n))'^ ^ Var -5- 1, n — > cxd. On 

p. 145 in [22], the authors of Theorem 14. II as in Section [4] of the present paper, 
with applications of their theorem in mind, pose the question of having ()4.ip 
with some matrix Vn as in Theorem 14.11 that would correspond to a case of 
independent nonidentically distributed random vectors, at least when the latter 
have finite covariance matrices. Hence, our (|3.4p can also be viewed as a partial 
answer to this question. 



3.2. Special characterization of the generalized domain of attraction 
of the multivariate normal law 

The purpose of this subsection is to establish a special, convenient character- 
ization of the generalized domain of attraction of the multivariate normal law 
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(GDAN) as in Theorem l3.2l It will enable us to apply Theorem l4.3l for obtaining 
an auxiliary CLT of (a) of Theorem 13.31 for proving (a) of Theorem 12.11 in the 
SEIVM (|l.ip . By establishing Theorem 13. 2i we also give an example of special 
vectors Z = {Z'~'^\- ■ ■ , Zt'^)) for which the fact that Z^^^ e DAN for alll < j < d 
characterizes that Z G GDAN. In this example we get away from the condition 
that components Z^^^^ of vector Z are identically distributed as in the related 
example with spherically symmetric Z at the end of Remark 14.51 

We recall that random vector Z is a full vector, or has a full distribution, if 
{Z, u) is a nondegenerate r.v. for all deterministic unit norm vectors u. In the 
sequel, for Z eTR'^, when d > 2, ^('=.'=+0 = {Z^''\ Z^''+^\ ■ ■ ■ , ^^=+0) denotes a 
subvector of Z that has all the components of Z starting with Z^'^^ and ending 
with l<k<d-l, l<l<k + l<d. Notation diag(-, •••,•) stands for 

a block-diagonal matrix, where in the brackets square matrix blocks that are on 
its diagonal are hsted. 

Theorem 3.2. Let {Z, Zi, i > 1} be i.i.d. random vectors in TR"^ . Suppose that 

for j^k, E\Z^^^Z^^'^\ <oo, if E(Z^j^f^<x, and/or E{Z^^^f:^oo. 

(3.10) 

For vector Z formed by all the components, if any, of Z whose second moments 
exist, assume that 

Z is full. (3.11) 
Then the following two statements are equivalent: 

(a) Z G GDAN; 

(b) Z(J) e DAN for all 1 < j < d. 

Proof. That (a) implies (b) is explained in Remark 14. 51 

Conversely, assume that (b) holds true. By equivalence of the (a) and (b) parts 
of Theorem l4.2[ the proof of (a) of this lemma reduces to verifying convergence 
in (b) of Theorem 14. 21 for suitably chosen matrices provided that vector Z 
is full. Clearly, we are concerned with the case of d > 2 only. 

If E{Z'^^^f < oo for all 1 < j < d, then Z = Z is fuU by (|3ll|) . Hence, 
Gov Z > and, due to a weak law of large numbers applied to each entry of 
Y17=i(^i ^ Z)'^{Zi — Z), the (b) part of Theorem 14.21 is satisfied with matrix 

B„ =n-i/2 (CovZ)^^/^ (3.12) 

Suppose now that, without loss of generality, £^(Z(^')^ = oo for all 1 < j < m, 
1 < m < d, while i?(Z'^-'')^ < oo for all m + 1 < j < d. First, note that such vec- 
tor Z is full and thus, Theorem l4.2l is applicable. Indeed, for any unit norm scalar 
vector M, Var(Z, u) = X;j=i(w(^'))2Var Z^J) X;^^^^ w^^'^"^''^cov(Z(^) , Z^), and, 

if H h > 0, on account of ([3T0|) . Var (Z, u) = cx), while when 

■u^i' = . . . = = 0, Var (Z, u) > by ([3TT|1 . Next, we introduce the block- 
diagonal matrix 

i?„ -n-i/2diag((^(i)(n))-i,...,(£('")(n))-\ (Cov z("+i' '^)) ) , (3.13) 
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where i'-^^n) / cx), • • • , / oo are slowly varying functions at infinity 

that correspond to Z^j'> e DAN (cf. Remark ll.ip . namely, we have for 1 < j < 
m, 

SU|^..<0.,, ,3,., 

Note that (CovZ(™+i^'')) "^^^ in (jXT^ is well-defined on account of (|XTT|) . For 
-B„ as in p.l3p , we are to verify convergence in the (b) part of Theorem 14.21 
namely, that 

n n 
BnJ2iZ^ - Z fiZr - Z)Bl = Br, ^ S.^zzB^ 
i=l 1=1 

:=^" = (4'WM=(fi2)T;^3)-/<i, n-oo, (3.15) 
where matrix En consists of the following matrix blocks: 

En 
i=l Si,ZU> ZW /„ -, „^ 

^n - ye.n h<.^<m , wi.n e^, = ^^u) ^^y (3-16) 

En 

^n = l^n jl<J<m,m+l<fc<d , 6:^^ = COnSt ■ 



n 



+ ■■■+ const -Try— , (3.17 

with some absolute constants in p.l7p depending on j and fc, but not on n, and 



Et 



(CovZ(™+i^'^)) ^^^^'^-^'-J^""^""^^"" (CovZ("+i^'^)) (3.18) 



As n — > c», on account of (I3.14p and (|4.7p of Remark WM 



^ 1 for aU 1 < j < m, (3.19) 



and, due to ((3?T0)) and the fact that ^^''{n) / oo, 1 < j < m, 

e^'= ^ for j ^ fc, 1 < j < m and 1 < fc < d, (3.20) 

while, clearly, 

4 (3.21) 

This concludes the proof of the convergence in (|3.15p with i?„ as in (|3.13p . 

Finally, the third type of vectors satisfying (|3.10p , (|3.1ip and having all their 
components in DAN consists of vectors Z with E{Z^^^)'^ = oo for all 1 < j < d. 
Such vectors Z are full, since for any deterministic unit norm vector it, on 
account of ()3.10|) . Var {Z, u) = oo. Put 



B„ = n 



-i/2diag((^(i)(n))-i, . . . , {l^^Kn))-^) , (3.22) 
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where £^^\n) are as in (|3.14p . and £^^'>{n) /* cx), n ^ oo, for all 1 < < d. For 
all elements e-'*^ of matrix En in p.lSp defined now via i?„ of (|3.22p . by (|4.7p 
and ([3J01) . 

- W) (n)^(^) (n) ^ \ 0, j ^ fc, ^ " ^' ^ " ^' ^"^'^^^ 

as n — > oo. Hence, convergence in probability in p.lSp with _B„ of p.22p is 
valid. □ 

Remark 3.2. Relationship in p.lOp may follow from independence of Z^^^ 
and Z^*"'' and the existence of their respective first moments. According to the 
Cauchy-Schwarz inequality, (|3.10p is also satisfied when, e.g., Z'-^^ g DAN with 
= oo (from Remark [HI £;(Z(i))2-° < oo for any a e (0,2]), while 
£;(^0)j2+A ^ ^ fQj. gQj^g A > 0, for aU 2 < j < d. 



3.3. Auxiliary CLT's required for the proof of Theorem 12.11 in 
Section 13.41 



This subsection presents Theorems 13.31 and 13.41 containing auxiliary CLT's re- 
quired for the proof of Theorem 12.11 in Section 13.41 Theorems 13.31 and 13.41 are 
based on, and extend and unite, the auxihary results in [Ml [151 [TBI [17] . This 
subsection is written with the genuinely multivariate case of d > 1 in mind. This 
is understood from, but not spelled out in, some of the conditions and notations 
that are to appear (cf., e.g., (I3.25P ). However, simply omitting the arguments 
that are suitable and used only for the case of d > 1, makes the results of this 
subsection also valid for the case oi d = 1. 
Let 

C, = [{i^-m)5,, {ii-m)e^,5i,£i,5,ei-^i,Sj~\e,el-e^, l<i<n, (3.24) 

where 

_ {Ei, in the SEIVM prTj) . 

~ I Yimn^ooi, in the FEIVM pTj) . 

Using (|3.24p and vectors of constants bi, - ■ ■ ,bd in IR^, whose components are 
such that 

r Var C = oo, in the SEIVM, (i) _ (2) _ aU 2 < 7 < d 

{ lim„^oo ^2 = 00, in the FEIVM, " ''^ all ^ S J S 'i, 

(3.25) 

we define vectors 

J< = ((C.,6i),---,(0,M), l<^<n. (3.26) 

In the SEIVM (|l.ip . we will also consider random vectors ^0 and Jq that re- 
spectively generate and J;, namely, 

Co = ((C - m)S, (^ - TO)e, S, £, Se ~ fi,5^ ~ XO, - 6*) (3.27) 
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and 

Jo= ((Co,?>i),---, (Co,M)- (3.28) 

Next, for a special case of the multivariate Student statistic in (|3.1|) . we prove 
Theorem 13.31 the first of the two auxiliary theorems of this subsection. 

Theorem 3.3. Consider 5i„(J) — \/n JVjJ^^"^ based on Ji of \3.2&) that are 
defined via nonrandom vectors bi, ■ ■ ■ ,bd in IR^ satisfying l\3.25\i . 

(a) In the SEIVM (f7J|) . assume (A), (SI), (S2) and also that 
f Jo is full, if Var ^ < oo and/or b^^^ = b^^^ ~ 0, 



((Co, 62), • • • , (Co, ba)) IS full, */ Vare = 00 and \b[^^\ + \bf^\ 

(3.29) 



Then, as n —f 00, St„{J) N{0, Id). 



(b) In the FEIVM fTTT]) . let (A) and (F1)-(F3) be satisfied, and 

lim — CovJi > 0, i/lim„_oo < 00 and/or 6^^^ — 6^^' = 0, 



n — >CfO TL ■ 



1 

lim - V Gov jf'''^ > 0, i/lim„^ooF = 00 and \b[^^\ + > 



(3.30) 

Then, as n ~* 00, Stn{J) ~* N{0, Id). 

Proof of the (a) part of Theorem VS.'Sl The proof follows from Theorem l4.31 pro- 
vided that we show that Jo G GDAN by using Theorem l3.2l 

First, we argue that the components of Jo obey (|3.10p and (|3.1ip . Indeed, if 
Var^ < cx) and/or b[^^ = fof ^ = 0, then E (Co, bj)"^ < 00 for aU 1 < j < d, and 
due to (|3.29p , conditions (|3.10p and (|3.1ip are clear satisfied. If Var ^ — 00 and 
l^i^Vl^l^^l > 0, then (p:^ implies that E (Co, = 00, while E (Co, b^)^ < 00 
for all 2 < j < d. In this case ([XTTjl is guaranteed by (jX^ . while (PTTU)) 



(Co, 61) (Co, bj] 



< 00 for all "2 < j < d, that can be checked 



follows from E 
straightforwardly. 

Further, from (26) of the proof of Lemma 6 in ^7j, by noticing that condition 
(24) with (Co, bj) in place of (Co, b) in that lemma is now a part of (|3.29p . we 
have that (Co, bj) G DAN, for all I < j < d. Finally, on account of (b) implying 
(a) in Theorem [S3 Jo e GDAN. □ 

Proof of the (b) part of Theorem 13.31 Consider a triangular sequence of random 
vectors {Zi(n), 1 < i < n,n > 1}, where 

Zi{n) = 

if hm„_^oo < 00 and/or 5^^^ — 6^' ~ 0, 



j(l) j(2,d) - 



if lim„^oo e = oo and \b'i^\ + > 0, 
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(3.31) 

and Zi(n), • • • , Zn{n) are independent with E Zi{n) = and finite Qoy Zi{n). 

For Zi{n) of ()3.3ip . we are to check conditions ()3.2|) and ()3.3|) of Theorem l3.1l 
Ifhm„^oo^^ < oo and/or 6$^^'' = fep"* = 0. then by ()3.30|) . lim„^:^ Gov Z An) 

= hm„^oo X^iLi Gov Ji/n > 0. Otherwise, it is not hard to see that hm„^oo X]r=i 
Coy Z,{n) = diag foj'''^), hm„^oo ELi Gov jf , since by dSSSI, 

hm„^oo I]"=i cov(z|"^^(n), Zp^(n)) = hm„^oo(cortsi X]r=i(^i ~ m) + const ■ 
n)(nX;r=i(C» - m)^y^/^ = in this case. Hence, by (A) and ((330)) . ([S^) 



is also satisfied when lim„^oo^^ = oo and |6^^^| + \b'"i^\ > 0. As to the Linde- 
berg condition ()3.3|1 for ()3.31|) , it suffices to show that for all 1 < j,k < d, as 
n — > oo, 

for any > 0, ('(Zp')(n))2l|^^<„^^^^,^^|') ^ 0. (3.32) 



Let 



>(1,2) ^(3,7)^ 



(3.33) 



and 



Then, 



bjn = (v/ELite - m)2 6f V^&f '^)) , l<j<d. (3.34) 



(Ci,^i) = {lin,bjn)- (3.35) 

If lim„_ooF < oo and/or fe^^^ = fof ^ = 0, then by (l335ll . 



i=i ^ ' ^ i=i 

n 

< const ^ S ( 1 1 7,„ 1 1 2 1 1 ^^^^^ II p >^} ^ 



where for any 1 < j < d and large enough n, 

ll^jnlP _ const^"^^(^j - to)^ + const • 



< const. 



Consequently, (|3.32p reduces to the Lindeberg condition for {||7mi||,1 < * < 
n,n> 1} that amounts to having the verified (3.36) of the proof of Lemma 3.4 
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in [16] (we note that condition (F2) is replaced there by a weaker one, namely, 

liniinf„_,oo(F- iW) > 0). In the case of lim„^ooF = oo and \b[^^\ + \bf^\ > 
0, the arguments for (j3.32p are similar, and also lead to the just mentioned 
Lindeberg condition by additionally using (|3.25D . 

Thus, conditions ()3.2p and (13. 3p for ()3.3ip are satisfied, and by Theorem l3.1|, 



St„iZ{n)) ^ N{0,ld), n->oo. (3.36) 

Now, if lim„^oo^^ < oo and/or b[^^ = 6^' = 0, then 5t„(Z(n)) = 5t„(J) 

and ((336)1 implies S'i„(J) ^ iV(0, h), n oo. Otherwise, concluding the latter 
convergence from p.36p requires some work that takes the rest of the proof. 
Assume that lim„^oo — oo and + > 0. Define matrix 

Dn = diag ( , „ ^ , %i I . (3.37) 

Then Zi{n) — JiDn and 

SU{Z{n)) = V^JDr.V-;/l^^^ = ^in(J)T<;7'A.F-^g(„), (3.38) 



where matrix Vz{n)Z{n) = ("■-!) ^ Z]»Li (^»(" ) ~ 2'(n))^(Zi(n) - Z{n)). It was 
shown earlier in the proof that Ziin) of (I3.3ip obey the conditions of Theorem 
13.11 Combining (|3.4p and (|4.5p with A„ = S > therein, where matrix E is as 
in (|3.2p . we conclude that 

((n-l)Vz(„)z(n))"'/'-S-i/2, 

and hence, also, that 

{{n - l)Vzin)Z(n)f'^ = ((n - l)Vz(n)Z(n)Y^'^ ((" " 1 ) ) ^ ^^^'^ 

(3.39) 

as n ^ cxD. Next, we observe that in view of i 



E-i/2i?„(n - l)yjji?„E-^/2 = E-i/2(„ _ l)y2(„)2(„)E-^/2 4 71 ^ c». 

(3.40) 

Now, (13:4011 and gSJ) with ^4^^ = D-^^^l^ (A„ = D-^Y.D-^ > 0) therein 
result in, as n — > cxd, 

or, equivalently, in 

i?-i((n-l)K7j)-^/'-E-^/2. (3.41) 
From ([3?39l) and (lOT]) . as n ~> oo, 

(yjy^A.V^^-(Ig(„)) = ((n - l)V^z(„)z(„))^/' AT^ ((n - 1)10,/)"^/' - 

while the latter convergence, p.38p and p.36p yield S't„(J) N{0,ld), as 
n oo. □ 
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Remark 3.3. In general, condition (|3.29p is checked on a case-by-case basis, 
depending on the vectors bi, - ■ ■ ,bd in hand. The first hne of p.29p amounts 
to saying that r.v. {(^q, uibi + ■ ■ ■ + Udbd) is nondegenerate for any vector u = 
• • • , Ud), \\u\\ = 1. In particular, on account of the proof of Lemma 6 in |17| . 
the latter statement holds true when Var^ < oo and the first two components 
of vector uibi -I- • • • -I- Udbd are not simultaneously zero for any u = (iti, • • • , Ud), 

(12) (12) 

\\u\\ — 1, namely, when the nonrandom vectors b^ ' , • • • , 6^ ' are linearly inde- 
pendent. The assumption in the second line of (j3.29p is interpreted similarly. As 
to the conditions in (j3.30p , due to the similarity in form of the matrices Gov Jq 
and Gov Jq^''^' in the SEIVM respectively to those of lim„^oo n~-^ Sr=i Cov 
and lim„_oo«"^Er=iCovjf '''^ in the FEIVM, fXSO)) holds true whenever 
(|3.29p does. Indeed, the respective entries of the aforementioned corresponding 
matrices are the same functions of the moments and cross-moments of order < 4 
of the error terms, and of m = and, in case of Gov Jq, also of M — E£^^, 
when dealing with the SEIVM (jl.ip . and, respectively, of m = lim„^oo £, and, 
in case of lim„^oo Gov J^, also of Af — lim„_foo when the FEIVM 

(fTT]) obtains. Moreover, the assumptions in the FEIVM (fTT]) and SEIVM (fTTj) 
on the error moments, m and M are in complete synchrony (cf. (A), (SI), 
(Fl), (F2)). 

On using Theorem 13.31 we are to study another Studentized partial sum in 
Theorem l3.4[ the second auxiliary theorem of this subsection. This Studentized 
partial sum is a prototype for the main terms in the expansions for the Studen- 
tized estimators of {p,a,j) as in Theorem 12. II 

Let 

rii{n) ^ {jji ~ a,Xi,Si^yy - XO.Si^xy - fj.,Si^xx - 0), l<i<n, (3.42) 
Ci, C2, ■ • • , Crf € IR^ be nonzero vectors of constants, and 

Ki{n) = (^{rii{n), d),- ■ ■ ,{rii{n), Cd)^, I < i < n. (3.43) 

Theorem 3.4. Consider the random vectors in l \3.4^^ defined via ^3.42^ and 

nonzero deterministic vectors ci, ■ ■ ■ ,Cd in satisfying 

cf^P + cf^^O and cf(3^+cf^P + cf^0 for all 1 < j < d. (3.44) 

Assume also l\3.25^ for vectors bi, ■ ■ ■ ,bd in defined by 

6,^(2/3cf +cf\/3cf +2cf,cW,cf),cf,cf,cf), 1 < j < d. (3.45) 

(a) Let (A), (SI) and (S2) be valid in the SEIVM (f7T7|) . Suppose also that 
(TOa holds true. Then for Stn{K{n)) = Vn K {n)V~'^J^^j^ f^^^ ^ y^K{n) 

((n - l)-i E"Ll{K^{n) - 'K^f{K,{n) - 'Kin))) as n -> oo, 

Stn{K{n))^ N{0,ld)- 
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(b) Suppose that conditions (A), (F1)-(F3) and (fXgQ|) in the FEIVM ([777]) 
are satisfied. Then, as n ^ oo, Stn{K{n)) N{0,ld). 

Proof of the (a) part of Theorem 13.41 We have, 

St^Kin)) = (5t„(J) + i?(n)^7//')^J/V-Jf^(„), (3.46) 



where vector R{n) — ^Jn K{n) — %Jn J, and, according to (41) of [T^ and (13. 25^ 
for &j, components R^^\n) of vector R{n) are such that 



R^^'^{n) = op(l), if Var^ < oo and/or 6^^^ = fcf ^ = 0, 
''^^^^'"^ :op(l), ifVar^ = oo and 16^^^1 + 16^^! >0, (3.47) 



R^3)(n) = op{\), foraU2<j<d, 

with slowly varying function i^(n) as in Remark 1 1.11 such that H-^iji) Z' oo when 
Var^ — oo, n oo. If in (j3.46p . as n — > oo, 



^Rin)Vyf^' =op(l) (3.48) 
and 

yiryKiJmn) - (3.49) 

then the (a) part of Theorem 13.41 follows from that of Theorem 13.31 for Stn{J). 
First, we are to show p.48|) . Introduce matrix 



n-^diag((<'5(n)y'var(6P<5+6p^e)) \ (CovJ^^' ''V^) > 

^"='^ ifVare = oo,|6i^^|+|6f^| >0, 

ri~2 (Gov Jo)^2 , otherwise. 



(3.50) 

Note that Bn is well-defined on account of (A) and (|3.29p . Interpreting (|3.48p as 
a degenerate weak convergence in (H'^, ||-||), by Thcorcm l4.1l from the Appendix, 
for p.48p it suffices to show that, as n — > oo, 

B„in-l)VjjB^ ^ Id (3.51) 

and 

\\V^r^R{n)Bj^\\=op{l). (3.52) 

Convergence in (|3.5ip follows from the fact that Jq is as in (I3.10p and (|3.1ip 
(this was shown in the proof of the (a) part of Theorem l3.3p . and is argued the 
same way as convergence in p.l5p with therein matrices Bn as in ()3.12p or ()3.13p . 
In this regard, we also note that the correspondence of _B„ in (I3.50p to i?„ in 
(|3TT2l) or ([3131) is seen by noticing that if Var ^ = oo and |6^^^ | + |6f ^ | > 0, then, 

on account of Remark 10 in [H], J27=i -^f^ ( \/7iVar(fe^^^J + b^^^e)l^{n)\ ^ 
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^(0,1), n oo. As to (153^ . when Var^ < oo and/or b[^^ = fof^ = 0, it 
is a direct consequence of p.47p . Otherwise, namely under Var^ = oo and 

1^1^^ I + 1^1^^ I > 0> it is due to (jOT)) and observing that 



V« - lR{n)Bl 



^f^^R^^\n) (VH£^(n)v/Var(&i^^5+&f^e) 



V^{^R^^^''\n)n-^'^ {Coy 4'''^)-^/^ 



This completes the proof of p.48p . 

For estabhshing (|3.49|) . it suffices to prove that, as n ^ oo. 



{in-l)Vjj 



T/2 



and 



with matrix B„ given by p.50p . Since 



-T/2 p 



(3.53) 
(3.54) 



({n - l)Vjj) Bl = ((n - l)Vjj) B'^ (^B,,{n - l)VjjB^^) , 

then p.53p follows from the convergence in (|3.5ip via (|4.5p . Similarly, (|3.54p is 
a consequence of (|4.5I) and 



The rest of the proof is concerned with verifying (|3.55p . 
Defining vector 

Qi{n) := Ki{n) - J^, 

we have 

VK{n)K(n) = VjJ + VjQ(n) + Vq(„)j + Vq(„)q(„). 



(3.55) 



(3.56) 



(3.57) 



Due to (49) of Lemma 8 in [T7] (condition (24) in [T7] with hj as in (|3.45p in 
place of e of (37) in [17] is satisfied on account of (|3.25p and (|3.29p ). as n — > oo. 



Vqu 



Q(3)(n)Q0)(n) 



op(l), foralll<j<d. 



(3.58) 



where Q'f\n) is the j*"^ component of Qi{n). The latter and the Cauchy-Schwarz 
inequality applied to each off-diagonal entry of matrix Vq(„)q(„) yeild that 
p 



'^Q{n)Q{n) ^ O (zcro matrix), and therefore, 

Bnin - 1)Vq(„)q(„)B^ 



(3.59) 



with matrix _B„ of (|3.50p . as n ^ oo. Now, in view of (|3.5ip . p.57p and p.59p . 
convergence in (j3.55p is a consequence of 



(n)J 



oo, 



(3.60) 
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which, in turn, follows from (|3.5ip . (|3.59p and the Cauchy-Schwarz inequality 
applied to each of the entries of the converging matrix product in (|3.60p . While 
the latter implication is easily seen when Var^ < oo and/or b'"i^ = fej^-* = 0, 

otherwise, namely under Var^ = oo and |&^^^| + l^i^^l > 0, one should first 
obtain the explicit forms of the converging matrix products in p.5ip . (|3.59p 
and ([SleOll via the hues in ((37T5| - ([3A8l) . □ 

Proof of the (b) part of Theorem 13. 4[ The proof follows the same scheme as the 
one used for the proof of the (a) part of Theorem l3.4l Instead of (I3.47P we now 
have 

= op(l), if lim„^ooF < oo and/or b[^'> = b[^^ = 0, 

.^^2M^= = op(l), if lim„_ooF= oo and \b['^\ + Ifo^'^l > 0, 

= op(l), foraU2<j<d, 

(3.61) 

which follows from (3.53) in [16] and (|3.25p . In place of B„ of (|3.50p . we choose 
here matrix 

„ _ r S-i/2„-i/2^ if lim„_oo F < oo and/or b[^^ = bf^ = 0, ,^ 
[ S ' Dn, otherwise, 

where matrix S > is as in p.2p that reads for Zi{n) of (j3.3ip . while matrix 
Dn is defined in p.37p . Then, convergence in (|3.5ip with _B„ of p.62p is due to 
having ((33T1) . ((O)) and ((OO)) . As to the validity of ((332)) in the context of the 
FEIVM (fLT]) . with S„ of ([3321) . it is based on ([33T|) and convergence 

SLrte-^)^ "^^' n-oo, (3.63) 

which amounts to (3.28) in [TB]. Thus, ((Hlig)) in the FEIVM is verified via the 
appropriate versions of p.5ip and (|3.52p . 

Now, we are to argue p.49p in the present context. In fact, we only need 
to show ([^351) with Bn of dSUl). By (3.54) in [H] and dS^S]), for Q,{n) as in 
(|336l) . 

^Q(i)(«)Q(i)(n) = if lim„^oo < oo and/or b[^'' = = 0, 

— — =— op(l), if lim„_^oo e = oo and |5i ^ | + |6i ^ | > 0, 

^QW)(n)QO)(n) = op(l), for all 2 < j < d. 

(3.64) 

Combining ({333)) and ([3341) . we conclude ([3391) with B„ of ([3321) . □ 



Remark 3.4. The use of Theorem 13.41 can also go beyond the studies of the 
present paper, since Theorem 13.41 is suitable for establishing joint CLT's for 
estimators, other than those in (|1.3p - (|1.5p . that are also appropriately based on 
vector (y,x, Syy, S^y, S^^x) in the SEIVM ITT]) and FEIVM HIT]). 
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Remark 3.5. We note that, via [H [HI UHl [Tl] , Theorem [Q can be adapted 
for the no- intercept versions of the SEIVM pTTj) and FEIVM pTTj) . where the 
intercept a is known to be zero, and respective CLT's for estimators that are 
appropriately based on vector {y,x,y^,xy,x'^) can thus be estabhshed. 

3.4. Proof of Theorem [Q 

The proof of Thcorcm l2.1l is given for the MLSE's /?3„ and a^n , and the MME 73„ 
only, simultaneously for the SEIVM pTTj) and FEIVM (fTTTI) . The corresponding 
CLT's for {(3j mOijm "fjn) for j — 1 and 2 can be established in similar ways and 
thus, the respective proofs are omitted here. 

Proof of the (a) part of Theorem 12. 1[ From the proofs of Theorems 1-3 in |17| , 
and the proofs of the (a) parts of Theorems 2.2 and 2.3 in [16], and also by 
following the lines of the proofs of Theorems 1.1.2c and 2.1.2c in [15], we have 

v^;7(3,n)(/33„ - f3) = y/nu{3 ,n, f3), 

V^{a3n-a) = V^v'i3, n,(3) + opi l), (3.65) 
^/nL{3,n)(j3„ - 7) = ^/nw{3,n,P) + op(l), 

where 

{Ui-a-Pxi ^^Ui(3,n,/?) , if E = M < 00 (in the SEIVM), 
M — m'^ 
or hm ^2 = Af < 00 (in the FEIVM), 
n— >oo 
yi~a — f3xi , if Var^ — cso, or lim — cso, 
n — >oo 

(3.66) 

with (in the SEIVM), or m = hm„^oo? (in the FEIVM). Put 

K,{n) - (u,{3, n, (i), v[[?,, n, /?), u-(3, n, /?)) . (3.67) 

Then from ([SlBS]) . 

V^(c/(3,n)(/33„ - /?), a^n ~ a,L(3,n)(73„ - 7)) K(3^^^/3)2(3,n,/3) 
= : (V^if(n) +p(n)) T^,73^^'0),(3,„,^) 

(3.68) 

with 

||p(n)|| -op(l). (3.69) 
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Next, we check the conditions of Theorem 13.41 for having Stn{K{n)) — > 
N{Q,Id), n oo. For Ki{n) as in p.67p . the corresponding vectors ci, C2 and 
C3 as in (|3.43p are 



(1,-/3,0,0,0)-— ^ci ,ifi;e2 = M<oo, 



ci = (0,0,0,1,-/3), 
r (1,-/3,0,0,0) 

C2 = S or hm„_^oo = M < cx3, _ 

[ (1, -(3, 0, 0, 0) , if Var^ = 00, or Um„^oo = 00, 

C3 = (0,0,1, -2/3, /32), 



while vectors 61, 62 and 63 as in p.45p are 

bi = (1,-/3,0,0,1,0,-/3), 



(3.70) 



m m/3 -,0 n 



. ^ M-m2'M-m2' ' M-m?' ' M - m? ^ 

^ ^ if ^ Af < 00, or hm„^oo = M < 00, ^ ^ 

(0,0,1,-/3,0,0,0), if Var^ = cx), or hm„^oc = 00, 
&3 = (0,0,0,0,-2/3,l,/32). 

It is not hard to see that ci, C2, C3 of (|3.70p satisfy (|3.44p . while bi, 62, &3 of 
(PTT|) obey ([X^ . Hence, we only need to check (P?^ and ([530)1 with the 
vectors 61, 62, ^3 of (|3.7ip . In fact, according to Remark [231 it suffices to verify 
([5:^ only Since \b[^^\ + > 0, (IX^ reads here as 

f vector ((Co, ^i), (Co, ^2), (Co, ^a)) is full, if VarC < 00, , , 

\ vector ((Co, 62), (Co,&3)) is full, if VarC - 00. ^-"''^^ 

Suppose first that Var^ = 00. If vector ((Co, 62), (Co, ^3)) is not full, then there 
exists vector u = {u2,uz) € H^, ||m|| — 1, such that 

^t2(Co, ^2) + U3(Co, ^3) = almost surely (a.s.). (3.73) 

If U3 = 0, then ([575)1 reduces to (Co,fe2) = Oa.s., or to Var(Co, 62) = ((l,-/3)r, (1, 
— /3)) = 0, and the latter equality contradicts positive definiteness of T as in 
(A). Assume now that U3 7^ in (I3.73p . Then it can be shown that (|3.73p 
is equivalent to (^2/ (2^3) + {5 — (3e) ) ~ u1/{Au1) + E{5 — /3£)^ a.s., or to 
6 — (3e = :L^u\l (4u|) + E{8 — /3e)2 - uil(2uz) a.s. that means that S — Pe 
would have to be discretely distributed. However, this would violate (B). 

Suppose now that VarC < 00. We are to prove that the vector ((Co,^i), (Co, ^2), 
(Co, ^3)) is full. Consider r.v. 

ip = (Co, "i&i + W2&2 + M3&3) (3.74) 

for all real ui, U2, U3, where || (wi, U2, ^3)!! = 1. We seperate the following four 
cases in terms of mi and 1*3. 

1) If ui = U3 = 0, then VarV^ = Var(Co, W2&2) = ^i2Var(Co, 62)- If m ^ 0, then 
1^2^'' I + |&2^''| > and Var-0 > by Remark 13.31 Otherwise, when m = 0, 
VarV- = ((1, -/3)r, (1, -/3)) > since T > by (A). 
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2) Assume that ui — 0, but 1*3 7^ 0. Provided that M2 7^ and m ^ 0, 
vector (1*262 + "363)'^-'^'^) = U2b^'^^ = —U2m{M — m?)~^b'"^'^'' is nonzero 
and hence, for ip of p.74p . Vai-t/j > by Remark 13.31 If U2 = 0, then 
Var ^; = u|Var( (i5 — /gg)^ — — /gg)^) > 0, because the situation d — Pe = 
±y/E{S — l3eY a.s. is prevented via (B) {5 — fie cannot be discretely 
distributed). If m = 0, then the expression for 62 is as in the case Var^ = 
00 (cf. p.7ip ). and the proof of that Vari/i > goes exactly like that of 
disproving p.73p under Var^ = 00. 

3) Let ui^Q andu3 = 0. If wifoj^'^^ + 1*26^^'^^ = (ui - U2m(M- m^)-!)^^^'^) 
is not a zero vector, then from Remark l3.3i Var?/' = Var(('oj uibi +U2&2) > 
0, while otherwise, namely, equivalently if ui = U2m{M — m^)^^, then 
uib^i''^'^ + U2&2^'^'' is a zero vector and, due to positive definiteness of T 
assumed in (A), 

Var^A = Var(Co, ui&i + ^262) = Var(C^^'^\ (wi^i + U2&2)^^'^^> 

-(3,4) ,(3,4)> _ 



= Var(Cr^\,.26r -^2((l,-/3)r,(l,-/3)) >0. 



(1,2) 



4) Finally, consider the case of wi 7^ and 713 7^ 0. If vector uib]^ 

M262 ' + '^sba ' is nonzero, then Yaiip > by Remark 13.31 Otherwise, 

1 -f 1,(1,2) , ,(1,2) , ,(1,2) ,(1,2) , ,(1,2) , i-./r 

namely, II MiOj^ +M2O2 +W3'^3 =""101 +W2O2 — \u\ — U2m\M — 
vr?)~^y3\''^^ is a zero vector, then so is vector u\b^^''^'' + M2&2^'^'' — (wi — 
M2m(M-m2)-i)6f''^^ and VarV' = Var(C,^^'^' , + U262 + ^3^3)^^'^^) = 
N.Au2{C}t'\br^)^u,(^c!i^'\br^^^^^ 

b^'"^^)) = ((Co, ^2), (Co, ^3)), with vector 62 equal to 62 as in case of Var^ = 
00 (cf. (|3.7ip ). Also, \u2\ + |m3| > 0. Consequently, using the just obtained 
expression for Var^', we conclude that, on account of that (|3.73p fails, 
Varf/; > 0. 



This completes verification of (I3.72p . 

Consequently, by TheoremEU Stn{K{n)) A A^(0,/d), as n 00. Hence, in 
view of (|3.68p . the proof reduces to showing that, as n ^ 00, 

M^)yKlImn)\\-op{l) (3.75) 

and ^ 

^K(n)K{n)^zCi,n,f3)z{Z,n,l3) ~^ ^3- (3.76) 

Similarly to the proof of (|3.48[) . (|3.75[) is on account of p.55p (proved both 
for the SEIVM and FEIVM versions of (HI])) and 

\\V^r^p{n)B^\\=opil), (3.77) 

where p{n) is as in ([3?69| . matrix B„ is as in p.50p in the SEIVM, with vec- 
tor Jo = ((Co,6i), (Co,fo2), (Co,63)), or as in f^Wf in the FEIVM, with ma- 
trix S of (|3.2p corresponding to vectors Zi{n) of (|3.3ip that are based on 
Ji = ((Ci, ^i), (Ci, ^2), (Ci, ^3)), where the vectors &i, 62 and 63 are as in (|3.7ip . 
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As to the convergence in p.76l) . it suffices to show that, as n ^ oo, 

{{n - 1)VV(„)K(„))^^' ^ ^3 (3.78) 

and 

B-^ {{n - f)K(3,„,,5).(3,„,/3))"^^' ^ h, (3.79) 
with matrix _B„ as above. Since 

= [{n - l)VK{n)K(n)) {Bn{n ~ l)VK(n)K{n)Bn) , 

(PTfg)) is a consequence of (1535)) (proved both for the SEIVM and FEfVM) and 
(|4.5p . fn the same manner, by (14. 5|) . (|3.79p is due to 



Bn{n - l)V^(ji^n,p)z(?.,n,i})Bl ^ h, n-^oo. (3.80) 

By writing 

Vz{3,n,l3)z{3,n,l3) — VK{n)K{n) + VK{n)A{n) + VA{n)K{n) + VA{n)A{n), 

where vectors 

A,(n) = z,(3, 71, 13) - K,{n) = (0, v,{?,, n, /3) - v[{?,, n, (3), 0), (3.8f ) 

with Wi(3, n, (3) of (12. 3|) and Wj'(3, rt, /?) of (I3.66p . and by using similar arguments 
to those for ((?35)) . (P?M)l resuhs from ([XTO)) and 

5„(n - l)V^in)A{n)Bl ^0, n ^ oo. (3.82) 

As to the vahdity of (P?5^ . the hues in 17J that are right below (64) and (67) 
imply that in the SEIVM V'^(2)(„)A(2)(n) — op(l), n oo. Mutatis mutandis, 
the latter holds true also in the FEIVM. This leads to ((3^ . □ 

Proof of the (b) part of Theorem \2.\\ If, as n — > oo. 



then the (b) part of Theorcm l2.1l follows from its (a) part. As n ^ oo, 

((" - l)V;(3,n,/3).(3,n,/5))^^' ^ ^3 (3.84) 

and 

((" - l)^.(3,„,ft„).(3,„,ft„)) - ^3 (3.85) 

guarantee (|3.83p , where matrix i?„ is given by the appropriate versions of (|3.50p 
and ([53^ in the SEIVM and FEIVM respectively, just like in the proof of the 
(a) part of Theorem 12.11 
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Using (|4.5p . (|3.80p and representation 

((n - l)V^{3M.P)z(3,n.l3))'^^^ 

= ((n - ^)Vz(-i^n,p)z(?,,n,l3)) ^ {Bn{n - l)Vz(3^n,(3)z{Z,n,l3)Bn) , 

we conclude p.84p . 
Since 

^z(3,n,ft„)2(3,«,ft„) = ^2(3,«,/3)z(3,n,/3) + V2(3,„^/3)p(„) + V"p(„)2(3,„^^) + l^p(„)p(„), 

with vectors 

Pi{n) = z(3, n,/3,„) - Zi{'S,n,P), (3.86) 

then by similar arguments to those for ()3.55|) . convergence in ()3.85|) is a conse- 
quence of p.80p and 

Bn(n - l)yp(„)p(„)S„ -^Q, n^oo. (3.87) 

Now we argue the validity of (|3.87p . From the lines of the proofs of Theorems 2 
and 3 in [17], the (b) parts of Theorems 2.2 and 2.3 in [16 and Theorems 1.1.3c 
and 2.1.3c in [l^, we have 

- ^p(i)(n)pa)M intheSEIVM, 
"^r'^")^"'i"^ = op(l), in the FEIVM, ^''''^ 

iEr=i(c.-c)^ 

T/^(2)(„)p(2)(„) = Op(l), yp(3)(„)p(3)(„) ==Op(l) 

and hence, also p.87p . □ 

Proof related to Remark \2.?>\ In view of (I3.83p . it suffices to show that under 
dM]) (in the SEIVM) and ([27]) (in the FEIVM), subject to the additional nor- 
mality model conditions in [3] and comments on (B) in Remarks 12.81 and 12. 9|, 
the (a) part of Theorem 12 . 1 1 implies corresponding -^n— asymptotic normality of 

ni Oijni '~fjn 

), 1 < j < 3, as in [SmilH]. Due to similar arguments, we consider 
here the case of j = 3 only. 

From dsn withB„ =n-V2(^Cov((Co,6i),(Co,fo2),(Co,63))) in the 

SEIVM and B„ = ( Eti Cov((C., 6i), (G, 62), (0, ^3))) in the FEIVM, 
where vectors bi, 62, &3 are as in (|3.7ip . and from the corresponding (|3.29p 
and (|3.30p that have been checked in the (a) part of Theorem 12.11 via assuming 
(B), 



YT/2 _P .T/2 



T/2 

in the SEIVM, 



(Cov((Co,6i),(Co,fo2),(Co,fo3)) 

(lim„^oo n-^ ELi Cov((0, 61), (0, 62), (C^, ^3)))^^', in the FEIVM. 

(3.89) 
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Next, as n oo, since U{3, n) = Sxx — 9 ^ M — rn^ > 0, with M and m as in 
(EH) or (1121), then 

(diag(t/(3,n),l,L(3,n))) ^ 4 (diag(M - m^ 1, 1))"^ := n -> oo. 

(3.90) 

Finally, the (a) part of Theorem 12.11 with j = 3 that reads as 

V" (C^(3, n)(j3-in - P), asn - a, L{3, n)(j3n ~ 7)) V^(ln,p)z{3,n,l3) 

= Vn (Psn - f3, - a,73« - 7)diag(J7(3, n),l,L(3, '^))K(3^^^^)^(3,„,/3) 
^7V(0,/3), n^oo, 
and convergence in (|3.89p and (|3.90p imply that 

V^(d3n- P,a3n-a,%n-^'^ ^ N{0,D-^AD-^), n^oo, (3.91) 

where matrix D^^AD^^ reduces to the covariance matrix of the corresponding 
asymptotically normal distribution that is obtained in 3j, subject to the therein 
assumed additional normality model conditions spelled out in Remark l2.3l that 
replace our weaker assumption (B) that was used to conclude (|3.9ip here (for 
a summary on (B) we refer to Remarks 12.81 and 12. 9p . □ 

4. Appendix: some results on Studentization of random vectors by a 
matrix and the generalized domain of attraction of the 
multivariate normal law 

This appendix of some well-known results on recent advances in Studentization 
of random vectors by a matrix and the generalized domain of attraction of the 
multivariate normal law (GDAN) is provided here for convenience in references 
that are required for reading Section [3] of this paper. 

Motivated by the importance of having matrix Studentized CLT's for random 
vectors converging in distribution to a spherically symmetric random vector Z, 
which is such that all its Euclidean inner products (Z, u) with a deterministic 
vector u of unit Euclidean norm have the same ditribution coinciding with that 
of each single component of Z, Vu, Mailer and Klass [Hj established a rather 
general result of such a nature. Their result that follows herewith is essentially 
a general recipe of matrix "Slutskying" for random vectors. 

Theorem 4.1. Forn > 1, let C„ be dxd real invertible nonstochastic matrices, 
Vn be dxd real symmetric stochastic matrices and Sn be Ixd stochastic vectors. 
If, as n ^ 00, 

CnVnCl ^ Id, (4.1) 

with unit dxd matrix Id, and 



(4.2) 
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where Z is a spherically symmetric random vector in H'', then 

S^V-^I-" ^ Z. (4.3) 

Remark 4.1. We note that (14. ip amounts to saying that each entry of matrix 
C'nKiC^f converges in probabihty to the corresponding entry of Id- As noted in 
[22] , (|4.ip iniphes that l/„ > on sets whose probabihties converge to one, as 
n — > oo. Hence, the Cholesky and the symmetric positive definite square roots 
of Vn and, consequently, Yn'^^'^ in l|4.3[) are weU-defined. 

Remark 4.2. This is a technical remark related to Theorem 14.11 and frequently 
used in Section[3l It is noted in [22] that if instead of (|4.ip and (|4.2p one assumes, 
as n ^ oo, 

A-^I^Vr^A-^I^^U and S^^A-^I^^^Z, (4.4) 

with d X d real matrices An > 0, n > 1, then spherical symmetry of Z is not 
required for the conclusion in (|4.3p . Moreover, if (|4.4p is assumed to begin with 
in [22], then the proof of corresponding (|4.3p there reduces to showing that, as 
n — > oo. 

An'/' K A7^/^ - implies ^J/^ K.-^/^ = {V-'^' A^^'Y 4 (4.5) 

A definition of the generalized domain of attraction of the d— variate normal 
law, denoted here by GDAN in view of the previously used DAN as in (SI), 
reads as follows. 

Definition 4.1. Let {Z, Zi, i > 1} be i.i.d. random vectors in IR'^. Z is said to 
belong to GDAN if there exist nonstochastic sequences of vectors a„ and d x d 
matrices Bn, such that 

(^^Z,~a,}jBl ^ iV(0,/d), as n^oo. (4.6) 

Remark 4.3. It was shown in Mailer [13] that if dm holds, then £;||Z||" < oo 
for all < a < 2 and a„ can be taken as nEZ ^ while norming matrix i?„ is 
invertible for large enough n and may be chosen to be symmetric. Also, i?„ 0, 
as n — > oo. As a general fact, it is also known that (|4.6p implies that Z is full 
(cf. Lemma 3.3.3 in [TS]). 

Below we review some known equivalent characterizations of GDAN that are 
found in Theorem 1.1 of Mailer [13] and are most relevant to the aims of this 
paper. 

Theorem 4.2. Let {Z, Zi, i > 1} be i.i.d. random vectors in IR'^ having a full 
distribution. The following statements are equivalent: 

(a) Z e GDAN; 
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Bn^iZi - Z)'^{Z^ - Z)B'^ ^ Id, as oo; 



(b) there exist nonstochastic square matrices Bn such that 

n 
i=l 

x^p(\{Z,u)\ > xj 

(c) sup — ^— 

uem.^. \\u\\=iEi^{Z,u)^l{^(^z,u)\<.} 

Remark 4.4. Equivalence of (a) and (c) in Theorem 14.21 under EZ = is 
one of the main results of the seminal paper by Hahn and Klass [10 that has 
stimulated intensive studies of GDAN. The (b) part of Theorem 14.21 can be 
viewed as an analogue of the following result for DAN that was rediscovered 
by Mailer 12J to conclude a CLT for self-normalized partial sums of i.i.d.r.v.'s 
from DAN. It is essentially a variation of Theorems 4 and 5 on pp. 143-144 in 
Gnedenko and Kolmogorov Accordingly, if {Z,Zi,i > 1} are i.i.d.r.v.'s in 
DAN, then 

n 

Y,(Z^-EZ)ybl^^, 71 ^oo, (4.7) 

where 6„ is such that X]r=i(^* ^ E Z)/bn N{0, 1), as n — > oo. 

Remark 4.5. It is easy to see that if Z g GDAN, then each component Z^^^ 
of Z is in DAN, 1 < j < d. Indeed, the (c) part of Theorem 14.21 implies that 



E 



0, x^oo. (4.8) 



The latter convergence is known as Levy's necessary and sufficient condition 
for Z^J) to be in DAN (cf. PT]). On the other hand, assuming that aU Z^-') e 
DAN is not sufhcient alone to guarantee that Z e GDAN. Indeed, suppose that 
EZ = and aU Z^^' are identically distributed and belong to DAN. Then, from 
(|4.7p with bn chosen to be the same for all sequences {zl''\ i > I}, I < j < d, 

,,2 ^ 1> 71 ^oo. 4.9) 

dbi 

Further, from Remark (ii) on p. 193 of [13], via p. 236 of [5j, (|4.9p is equivalent 
to (148]) with \\Z\\ in place of and such a form of ((4T8l) does not imply (c) 

of Theorem 14.21 However, the class of spherically symmetric random vectors Z 
is pointed out in Remark (ii) on p. 217 of [13| as an exception in this regard, on 
account of each projection of Z having the same distribution coinciding with 
that of each single component Z^^^ of Z, 1 < j < d. 

For a multivariate Student statistic based on i.i.d. random vectors {Z, Zi, 
i > 1} in GDAN, by Mailer [B] and Vu, Mailer and Klass [H], the following 
CLT holds true. 
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Theorem 4.3. Let {Z, Zi, i > 1} be i.i.d. random vectors in JR*^ and Z S 
GDAN. Then, for the multivariate Student statistic Stn{Z) = ^JnZ {{n — 

Er=i(^» - W{Z, - Z))'^'"^, asn^oo, St^{Z - E Z) ^ N{Q, h). 

Remark 4.6. As noted in Remarks of [22], the proof of Theorem 14.31 goes 
by Theorem 14.11 via combining ()4.6p and the (b) part of Theorem 14.21 that 
presents a special case of ()4.ip . It is pointed out in [22] that, though Studen- 
tization in Theorems 14.11 and 14.31 can be performed by both the Cholesky and 
symmetric positive definite square roots, one's preference would depend on the 
problem in hand. It is also conjectured in [22] that for the purpose of trans- 
forming X]r=i('^« ~ EZ) so as to have approximately a spherically symmetric 
distribution, the symmetric positive definite square root is likely a better choice 
to accomplish this in small samples. 
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